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Enumeration of standard Young tableaux 
of shifted strips with constant width 
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Abstract Let gnx,n 2 b® the number of standard Young tableau of truncated shifted 
shape with ni rows and ^2 boxes in each row. By using of the integral method this 
paper derives the recurrence relations of gn,A and gn ,5 respectively. Specially, gn ,4 is 
the (2n — l)-st Pell number. 
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1 Introduction 


A shifted diagram of shape A = (Ai, • • • , Xd) (Ai > • • • > Xd) is an array of |A| boxes, 
where row i (from top to bottom) containing Aj boxes starts with its leftmost box in po¬ 
sition A standard shifted Young tableau of shape A is a labeling by{l,2,-- - ,|A|} 
of the boxes in the shifted diagram such that each row and column is increasing (from 
left to right and from top to bottom respectively). Specially, a standard Young tableaux 
(SYT) of shifted staircase shape is = (n, n — 1, • • • , 1). The enumeration of SYT is 
an important problem in enumerative combinatorics. See R. P. Stanley’s monograph [9] 
and R. M. Adin and Y. Roichman’s recent survey paper [2]. 

The number of SYT of shifted shape A is given by the well-known product formula)?, 
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A SYT of truncated shape is the SYT with some boxes removed from the NE corner, 
which was recently discussed by some authors [1, 6, 10]. Adin et ah in [1] derived 
the formulas of Sn truncated by a square or nearly a square by the method of pivoting 
theory. G. Panova independently obtained the product formulas of 6n truncated by a 
box in term of Schur function [6]. 

This paper considers the SYT of shifted shape in case of Ai = ■ ■ ■ = A^, which is 
the SYT of shifted shape {rii + n 2 — 1, Ui + 77-2 — 2, • • ■ , 772 ) truncated by a staircase 
namely a SYT of truncated shifted shape with 77i rows and 772 boxes in each row, 
illustrated as follows 


77i = 5, 772 


4. 


Let 5 'ni,n 2 (^i) ''^2 Y 2) be the number of SYT of truncated shifted shape with ?7i rows 
and 772 boxes in each row. It is clear that ( 72 ,n is the (77 — l)-th Catalan number L , 
gn ,2 = 1 and gn ,3 = 2"'“^. This kind of SYT of shifted strips with constant width has 
many applications. J. B. Lewis conjectured that the number of alternating permutations 
of length 277 — 2 avoiding the pattern 3412 is g^^n, which summation representation 
was given by G. Pabova [5]. In fact, gni,n 2 is also the number of ?7i x 772 matrices 
containing a permutation of [ 771772 ] in increasing order rowwise, columnwise, diagonally 
and (downwards) antidiagonally, because the character in increasing order antidiagonally 
of matrix coincides with the shifted property of SYT. 

Suppose T{n,k) is the number of n x k matrices containing a permutation of [nk] 
in increasing order rowwise, columnwise, diagonally and antidiagonally, R. H. Hardin 


gives several empirical formulas of T{n, k) in case of k <7 [8, A181196]: 

Empirical Recurrence Relations {R.H.Hardin) 

T(77,4) : an = 6a„_i - a„_2. (2) 

T(77, 5) : a„ = 24an-i - 40a„_2 - Suns- (3) 

T{n, 6) : = 120a„_i — 1672a„_2 + 544a„_3 — 6672a„_4 + 256a„_5. (4) 

T{n, 7) : = 720a„_i — 84448a„_2 + 1503360a„_3 — 17912224a„_4 — 318223104a„_5 

+ 564996096a„_6 + 270471168a„_7 - 11373824a„_8 + 65536a„_9. (5) 


In addition. Ping Sun in [10] shows that gni,n 2 is involved in the nested distribution 
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of ni groups of independent order statistics with n 2 samples from uniform distribution 
on interval (0,1). Generally, the order statistics model of SYT in [10] implies 

Proposition 1. Forni,n 2 > 2, 


^ni,n2 = {nin2y. ■ J{ni,n2) = (uiUs)! 



( 6 ) 


where D{ni,n2) is the following SYT-type integral domain (the variables are inereasing 
from left to right and from top to bottom) 


0 < xi,i < xi,2 <••• < a;i,n2 

A A 

^2,1 ^ * * * ^ ^2,n2 —1 ^ ^2,n2 


We derive the recurrence formulas of g^^n, gn ,4 and gn ,5 by using of the integral method 
of [10] in this paper. In Section 2 we evaluate the nested distribution of three groups of 
independent order statistics with n samples from uniform distribution on interval ( 0 , 1 ), 
which implies a new summation representation of g^^n- So that a non-homogeneous linear 
recurrence relation of g^^n is given. In Section 3 we compute the corresponding multiple 
integrals and prove the recurrence relations (2) and (3) respectively. In particular, 4 
is shown to be the (2n — l)-st Pell number which implies the empirical formula (2). 


2 New recurrence relation of ^3 ^ 

There are two results of g^^n in the literature. Considering the enumeration of SYT 
of shifted shape {n,n — l,i),0 < i < n — 2, G. Panova gives the following summation 
representation. 

Proposition 2. [5] For n>2, 

^ ^ {2n + i - l)\{n - i){n - i - 1) 

n\ {n — 1)! i\ (2n — l)(n -|- i)(n -|- i — 1) ’ 

For the number of 3 x n matrices containing a permutation of [3?7,] in increasing order 
rowwise, columnwise, diagonally and antidiagonally, V. Kotesovec gives the complicated 
order 2 recurrence relation. 
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Proposition 3. [8, A181197] For n>3, 

{2n - l)(7n - = 2(182n^ - 1185n=^ + 2722n^ - 2625n + 900) ■ 

+ 3(2n - 5)(3n - 5)(3n - 4)(7n - 6) ■ 5f3,n-2, s-s,! = fi'3,2 = 1- (8) 


For 0 < ti < ^2 < ^3 < 1, we consider the following integral 


<7n-l(tl, t‘2, ts) — 


lD(t) 


dxij, n >2, 


where D{t) is the following SYT-type integral domain 

0 <Xi^i < Xi ^2 < ■■■ < Xi^n-l <ti,l <i <3; Xi ^2 < X 2 ,l,X 2 ,n-l < X^^n- 2 ] 
tl < X 2 ,n-l-,t 2 < Xs^n-i; ^ ^2J+1 < X 3 J, 1 < J < n — 3. 

From Proposition 1, there is 

£/ 3 ,n = (3n)! jjj Jn-l{tl,t2,t3)dti, fl > 2. 


(9) 


Lemma 1. For n > 1, 0 < ti < ^2 < ts < 1, 


Jn{FM.t3) = -^ + 


n —1 


^ _ \ _1 1 f^n^2n—i^i _ ^2n—i^nA ^2n—iA ^n~\ /ifi'i 

n\3 ' „!(2n)! ^ V* ^ ^ ^ ^ ^ 2 ^ 3 + hh\ 


Proof. It is clear that 

^2) ^ 3 ) = ti{t2 — ti){t3 — ^ 2 ) = tlt2^3 ~ (^1^2 ~ ^1^2 + ^ 1 ^ 3 )- 
Suppose (10) is true for n — 1, then 


JJJ Jn-i{x,y,z)dxdydz 

0<x<ti<y<t2<z<t-i 


n-2 


n\ 


13 


(n- l)!(2n-2)! 




2n - 2 


1 


i J n{i + l)(2n — i — 1) 


t=0 

- ti+^) - - ti+^) + -1^)] 


xnxnxn o 

t'l ^2 ^3 I ^ 


n\'^ n 


!(2n)! 


n-1 /cy \ 

• i=o ^ * 7 
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where 


D /j- j. + 'i _ (+2n,n ,n,2n ,2n,n\ 

12, I 3 J — III ^2 ~ ^1^2 ~^lh) 


follows from the known identity [4, 14 


n—1 


1 ^ 

n!^ ^ n!(2n)! 




2 n 


= 0 


i=0 ^ ^ ^ 


( 11 ) 


The proof of lemma 1 is complete by induction. □ 

It should be noted that ^ 2 , ^ 3 ) is the shifted nested conditional distribution of 

three groups of independent order statistics with n samples from uniform distribution 
on interval (0,1)- The following result gives a non-homogeneous linear recurrence of 

92.,n- 


Theorem 1. For n > 1, the number of SYT of truncated shifted shape with 3 
rows and n boxes in each row satisfies 


7n+l f2n-2\f 3n \ 

92,n-\-l 93,71 "b 2 / ii\2l 1)1 1 )’ 

+ I)"'\ n — 1 / \n — 1/ 


93,1 = 1- 


( 12 ) 


Proof. For n > 2, combining (9) and (10) we have the summation representation 


93,71 — 


(3n)! 
6 • nP 


n—2 




i=0 


; (3n-l)!(5n-3f-3) 

n\ i\ {2n — z — 1)! (3?7. — i — 1) 


(13) 


Decomposing 5n — 3i — 3 = 3(3?7. — i — 1) — An in above summation, from (11) and 
Frisch’s identity [4, 4.2]: 


271-1 




i=0 


2n-l 


n + i 


(n- l)!(2n- 1)! 
(3n- 1)! ^ 


the summation representation (13) of is simplihed to be 
«3,.--^-h^+4(-l)- + (-l).M„ 


6 (2n — 1) n 


3n- 1 
n 


•An, 


where 


(14) 


A. = 5^(-i)’ 


i=0 


2n-l 


n + i 
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The recurrence of An is not difficult to derive by using of the equality (11). 


An+l — 


3n + 2 


y. .y (2n + l)! 
^ i\ (2n — i)\ 


i=0 


2n + l — i~^n + l + i 

^ (-l)^+^L+i) 2n(2n + l) /2n - 1 

3n + 2 (3n +l)(3n + 2) ^ 

_ {-ir+\Wn^ + 8n^-n-l){^:^^) 2n{2n + 1) 

2n(n +l)(3n +l)(3n + 2) ^ (3n + l)(3n + 2) ^ 

and the summation in last equality is equal to 

n 


2n — i^n+l + i 

n (2n-l\ 

V(-i)^ ^ , 

^ n + l + T 


i+i 


i=0 


2n- 1 
i + 1 


n + 1 + z 

(-ir‘ [(IT) - Lb)] 


2n 
i + 1 


= -A 


2n + 1 
in? 


i=0 


(2n)! 


_l)n+l 


6 n2(2n + l) 
therefore the recurrence of An is 

An-\-l 


in 

2n \ 
n+l)' 


i\ {2n — 1 — i)! 


1 1 
- + 


n + i 2n — i 


2n{2n +1) ^ , ^xn+i 28n^ + 22n^ — n — 1 / 2n 

“ 3(3n + l)(3n + 2)"^’' ^ ’ 6n(n + l)(3n + l)(3n + 2) Vn + 1 

So that the recurrence relation (12) of follows from 


Ai = 

2 




-1)” , I ^ I f ir 

3-l^ ^ n ("”-') ^ ^ 8n(2n - 1) V 


n 


The proof of theorem 1 is complete. □ 


3 Recurrence relations of ^^ 4 and 5 

It is well-known the Pell numbers Pn are dehned by the recurrence relation [8, A000129] 

Pn = 2,Pn-l + Pn-2, Pq = 0 , Pi = 1 . (15) 

The Pell numbers arise historically in the rational approximation to \/2, which are 
used to enumerate the numbers of certain pattern-avoiding permutations recently[3]. 
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Theorem 2. For n > 1, the number gn ,4 of SYT of truncated shifted shape with n 
rows and 4 boxes in each row is the ifln — l)-si Pell number P 2 n-i, which satisfies 

9n,4 = Q9n-1,4 “ 9n-2,4, 9l,4 = 1, 92,4 = 5. (16) 


Proof. For 1 < i < n, write the variable t 2 i-i corresponding to the box (z, z +1), t 2 i 
corresponding to the box (z, z + 2) in the SYT of shifted strip with width 4 respectively: 


□ 

li 

^2 


L 



la 

u 



n 


h 

h. 

□ 


o • 


t2n—li 


* — t2n- 


Proposition 1 implies that 

5'n,4 = (4zz)! /■■■/ ti{^-hn)Yl{t2i-l-t2i-3){t2i-t2i-2)dti---t 


0<tl<t2<t3<-<t2n<l 


1=2 


= (4rz)! 


(1 l'2ri) Jn{f'2n—l:l'2ri}dt2n—ldt2m ZZ Y 2. 

0<Z2n-l<Z2n<l 

We shall now use the method of induction to prove the following 


Jn{f'2n—l 1 t2n) 


/ ■ ■ ■ / ~ i2i-3){t2i ~ t2i-2)dti ' ' • f2n-2 

/ ^ *=2 


Q<ti<t2<t3< - ■ ■ <t2n-2<t2n-l 


±4n—4 
_ ^2n-l 

~ (4rz-3)! 

where Pi is the Pell number. 
It is clear that 


{(4rz — S)P 2 n- 2 t 2 n — [(4n — 4)P2n-2 “ -P2n-3]^2n-l} , (17) 


'72(^3) ^ 4 ) — 

0<ii<t2<^3 

which agrees with (17) because Pi = 1, P 2 = 2. 


r 

ti{t3 - ti){t4 - t2)dtidt2 = ^( 10^4 - 7 ^ 3 ), 

5! 
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Furthermore, from the recurrence relation (15) of Pell numbers, 


'Ai+1 (^2nH-l 5 ^2n+2) JJ 'Ai(^ 2 n— 15 ^2n) (^2n+l ^2n—1) (^2nH-2 ^2n)^^2n—1^^2n 

0<Ct2n —1 ‘^^2n'^^2n+l 

ri2n+l 


^2n 


lo (4n-l)! 


{(4n — l)P2n-lt2n+l — [(4n — 2)P2n-l — P2n-2]^2n}(^2n+2 “ ^2n)c^^2n 


t 


4n 

2n+l 


[(4n + l)P 2 nf 2 n +2 “ ( 4 nP 2 n “ P 2 n-l)t 2 n+l\ : 


{An + 1)! 

which shows (17) is true. Therefore, 


QnA = (4n)! 

0 

(4n)! 


0<Ct2n—1 ^i2n 

/*! r 


(4n-3)!7o 


(1 i2n) Jn{t2n—1: t2n)dt2n—ldt2n 

{An — A)P 2 n -2 ~ P2n-3 


P2n-2 — 


An —2 


t2n (1 - t2n)dt2n 


= An{An - 1) / 7 ^ 2 n-p 2 n (1 - t2n)dt2n = P2n-l 


It is clear (16) follows from the recurrence relation of Pell number. □ 

Theorem 3. For n> A, the numbers gn ,5 of SYT of truncated shifted shape with n 
rows and 5 boxes in each row satisfy the following recurrence relation 


9n,5 — 245f„_i^5 — 405 f„_ 2,5 — 8gn-3,5-, 9 i,5 — 1; 1 / 2,5 — 14, ^' 3^5 — 290. 


(18) 


Proof. We shall derive the recurrence of gn ,5 from the relations of certain integrals. 
For convenient, write the variables 0 < Xi < yi < Zi < Si < U < 1 corresponding to the 
five boxes in row i (1 < i < n) in the SYT of shifted strip with width 5 respectively. 


^n — \ 

Vn—l 

^n — 1 

^n—l 

^n —1 



Xn 

y-n 

Zn 

S-n 



From Proposition 1, we have 


9n,5 = (5n)! 


' D{n,b) 


dxidyidzidsidti 

8 


(5n)! ■ J„(5). 



Denote Di{xi^yi^Zi,Si) = 1, consider the following integral 


-^n(^n 7 Unt ^n-) ^n) 


dX\y\Z\S\t\ * * * l^/n—l^n—l^n—l^n—17 


-Dn— 1,55 Vn—l'^'^ni 
Zn-l'^yn-, Sn — l'^Zni tn—l'^^n 


Jn{5) can be written to be 


J„(5) = 


0<a:n-l<yn-l<2n,-l<Sn,-l <*n-l<-Sn5 
Sn-l<Zn, Zn-l<yn<Zn<Sn<tn<'i- 


(jjn yn—l)^n—l{Xn—l-i * * * 7 -^n—l)dX7i,—1 ’ ’ ’ tn—ldyn^n^ntn 

{-^nyn Bn)dZn — lSn — lin — ldyn^nSn^n^ (^9) 


0<2;n-l<Sn-l <in-l<Sn5 
Sn-l<Zn,Zn-l<yn<Zn<Sn<tn<'^ 


where 


An — 


-h^n—l(^n—1) Un—l: -^'n—Ij •^n—1 


O^Xn—l'^Pn—l ^^n — 1 


^5n-9 


^5n-8 


= C'i(n) 


-Sn_i - (72 (n)- 


J3n = 


?/n—l-h^n—1 (^n—1) Vn—lt ^n—li "^n—l)^^n—l^?/n—1 


O^^n — 1 ■^^n — 1 — 1 

5n—8 5n—7 

= C^3(n)-f^.._i-C4(n)- 


Notice that the dehnition of Dn{xn, Vn, Zn, Sn) implies 

A„+i= 11 D,Sx,„v„,z„,Sr9dx„dy„ 

{)'C.X'n<iy'fi<iZn 

I 'I (-4„!/.. - 

1 •\ 57 t,_ 1 <Ctn — i <iSn^ 


then 


( 20 ) 


An+i =[10(n — l)(5n — 7)(7i(n) — (lOn — ll)C' 2 (n) — (lOn — ll)(73(n) + 2(74(n)] x 


^5n—4 
'■'n 


(5n-4)! 


Sn - [(5n - 4)(5n - 7)(10n - ll)Ci{n) - 2(5n - 4)(5n - 6)(72(n) 


50(n — VfC‘i{n) + (lOn — 9)(74(n) 


^5n—3 


(5n-3)!' 
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By the similar arguments, 


Bn+l — 


VriDn 


Xr\ 


i) dXfidyn 


Q<C.Xn "^yn'^Z'n 



i^nUn 


Bnyri)dZn—\Sn—ltn—iyn 


— 1 — 1 ■\^n — 1 ? 

^n — 1 "^^71 i^n—l ’^Dn'^^n'^Sn 


= [(5n - 4)(5n - 7)(10n - ll)C'i(n) - 50(n - l)^C'2(n) - 2(5n - 4)(5n - 6)03^ 

^5n—3 

+ (lOn - 9 ) 04 ^]-^^--Sn - (5n - 3)[2(5n - 4)(5n - 6)(5n - 7)CAn) 

[on — 3)! 

^5n—2 

— (5n — 6)(10n — 9)C2(n) — (5n — 6)(10n — 9)C'3(n) + 10(n — l)C'4(n)]-— --r 

(on — 2)! 


Therefore, For n > 2, the recurrence relations of Ci{n) (1 < f < 4) are 


Ci(n + 1) =10(n — l)(5n — 7)Ci(n) — (lOn — ll)C2(n) — (lOn — ll)C'3(n) + 2C4(n), 
C'2(n + 1) =(5n - 4)(5n - 7)(10n - ll)C'i(n) - 2(5n - 4)(5n - 6)C'2(n) 

— 50(n — l)^C3(n) + (lOn — 9)C4(n), 

C'3(n + 1) =(5n - 4)(5n - 7)(10n - ll)C'i(n) - 50(n - l)^C'2(n) 

— 2(5n - 4)(5n - 6)C'3(n) + (lOn - 9)C'4(n), 

C'4(n + 1) =2(5n - 3)(5n - 4)(5n - 6)(5n - 7)C'i(n) - (5n - 3)(5n - 6)(10n - 9)C'2(n) 

— (5n — 3)(5n — 6)(10n — 9)C'3(n) + 10(n — l)(5n — 3)C4(n), 


with the initial values Ci(2) = 0, C 2 ( 2 ) = —1, C 3 ( 2 ) = 0, C 4 ( 2 ) = —2. 

On the other hand, combining (19) and (20), we have 

' 7 n( 5 ) ^n+ldZnSntn 

^ 5/7_3 

.. ]dZnSnt„ 

(on —4)! (5n —3)! 



0<CZn<7iSn'^in ^ 1 

(5n - 2)C'i(n + 1) - C' 2 (n + 1) 
“ (5n0! ^ 


then. 


gn ,5 = (5n - 2)C'i(n + 1) - C' 2 (n + 1), 


( 21 ) 
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and 


5 = (5n - 7)(25n - 2A)Ci{n) - (25n - 26)C'2(n) - (25n - 28 ) 03 ( 71 ) + 504 ( 77 ), (22) 

which follows from (21) and the recurrences of Ci{n). 

Furthermore, by using of the recurrence relations of Ci{n) again, (22) implies 

fi'n+ 1,5 =(577 - 2)(2577 + l)Oi(77 + 1) - (2577 - 1)02(77 + 1) 

- (2577 - 3 ) 03(77 + 1) + 504(77 + 1) 

= (577 - 7)(55077 - 524)Oi(77) - (55077 - 590)02(77) 

-(55077 - 594) 03 ( 77 )+ 11004 ( 77 ). (23) 

So that from (21)-(23) we have 

gn+l,^ = 22gn,5 + 4(577 - 7)Oi(77) + 1802 ( 77 ) - 2203 ( 77 ) 

= 22gn^5 + 4 g'„_i _5 + 22(02(77) — 03(77)], 77 > 2 . 

Finally, the recurrence relation of Ci{n) shows 

02(77 + 1 ) - 03(77 + 1 ) = 2(02(77) - 03(77)], 77 > 2 , 

which implies 

9n+l,5 ~ 22gn^5 — 45f„_i^5 = 2(gn,5 — 22gn-l,5 — ^gn-2,b)^ 77 > 3. 

The initial values = 1 , 5 ' 2,5 = 14 and 5 ^ 3,5 = 290 are obvious, then the proof of 
theorem 3 is complete. □ 

Acknowledgements 

The author would like to thank Yu Bao and Yanting He for helpful discussions. 


References 

( 1 ] Ron M. Adin, Ronald C. King, and Yuval Roichman, Enumeration of standard 
Young tableaux of certain truncated shapes. Electron. J. Combin., 18(2) (2011), 
P20. 


11 



[2] Ron M. Adin, Yuval Roichman, Enumeration of Standard Young Tableaux. arX- 
iv:1408.4497v2, 2014. 

[3] M. Barnabei, F. Bonetti, and M. Silimbani, Two permutation classes related to the 

Bubble Sort operator. Electron. J. Combin., 19(3) (2012), P25. 

[4] H. W. Gould, Combinatorial Identities. Morgantown, W. Va. 1972. 

[5] J. B. Lewis, Generating trees and pattern avoidance in alternating permutations. 
Electron. J. Combin., 19 (2012), ^ P21. 

[ 6 ] Greta Panova, Tableaux and plane partitions of truncated shapes. Adv. Appl. 
Math., 49:196-217, 2012. 

[7] I. Schur, On the representation of the symmetric and alternating groups by frac¬ 
tional linear substitutions. J. Reine Angew. Math. 139:155-250, 1911. 

[ 8 ] N. J. A. Sloane, The On-Line Encyclopedia of Integer Sequences, http://oeis.org. 

[9] Richard P. Stanley, Enumerative Combinatorics, vol. 2, Cambridge University 
Press, New York, 1999. 

[10] Ping Sun, Evaluating the numbers of some skew standard Young tableaux of trun¬ 
cated shapes. Electron. J. Combin. 22(1) (2015), 7 )^ PI.2. 

[11] R. M. Thrall, A combinatorial problem. Michigan Math. J. 1:81-88, 1952. 


12 



